Got it. I was indeed thinking to frame this blogpost as more lightheartedly. Would this be better: “We added typos to a benchmark, then Haiku’s scores jumped” so there is no mention of “saturation”. I’m thinking the blogpost is more of “why did Haiku’s score jump” instead of “LLMs are robust to typos”.
Got it. I was indeed thinking to frame this blogpost as more lightheartedly. Would this be better: “We added typos to a benchmark, then Haiku’s scores jumped” so there is no mention of “saturation”. I’m thinking the blogpost is more of “why did Haiku’s score jump” instead of “LLMs are robust to typos”.